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The results did not indicate a relationship exists between the student 
perception of ouality of instruction and the reputation departments have among 
peers for research and publication. The results did show, hoT/ever, tliat the 
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to field of study, and that the results of current research do enter into the 
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A STUDY OF THE RELATIOMSI^IP BEmETI QUALITY 
INSTRUCTIO:- AS PERCEIVi:!) BY STUDE^TTS km RISSEARCU PRODUCTIVITY 

IN ACADE2IIC DEPARTIIEOTS 



Ob jective 



The purpose of this study ±s to exatnlne the proposition that the quality of 
instruction is related to the quality of research in acaderaic departments at the 
University of Ifeshington. 



Introduction 

The Relationship Between Research and Teaching: Opinions 



Sanford (1967) and Jencks and Riesnan (1968) have amons others cemented upon 
the relationship existing between the graduate school with its research orientation 
and the teaching function.l Sanford stated, "More arid more, colleges have come to 
resemble graduate schools, a research specialist, the college teacher has the 
same interests as his colleagues in graduate school and naturally seeks to make his 
students resemble graduate students as early as possible, to the neglect of their 

general development. In this situation, teaching becomes a lost art "(Sanford,- 

1967, p. 169). Jencks and Riesman are more to the ooint, "T-Jhat the graduate 
schools define as 'research' trLll get done; what they exclude is likeiy to languish" 



The resulting national trend has been the dovmgrading of undergraduate 
instruction in favor of graduate education, the rush to the research project, 
increased consulting iiov business and government, and the published manuscript. 
Career conscious facuJ.Cy members know that recognition, mobility, pay raises and 
promotions come v/lth i>ublication, and coversely there is little reward for quality 
in instruction. Desmond (1969) put it most succinctly, "The total impact of these 
problem,-? is that the career interests of faculty are pitted squarely against the 
educational interests of students, especially the undergraduates"(p. 25). 

Stern (1969) speaks directly to the matter of departmental curriculum and 
faculty affairs: 



Graduate departments require graduate faculties, and these 
tend to be a very select group even among the total population 
of faculty Ph.D.»s. They have, been recruited for the past twenty 
years on the basis of their potential for research, publication, 
and program building. Having been screened even earlier for such 
qualities by their own graduate instructors, they are unquestion- 
ably the most aggressive, ambitious, energetic, counteractive. 



Of. Sample, 1972; Anderson, 1968. 



pragmatic, and Intellectually Independent of all graduate sclwol 
products, and committed both vocationally and by personal 
conviction to the development of others like themselves (p. 125). 

Stern (1969) goes on to be less descriptive and more pointed iu suggesting 
what the nature of the problem is in regard to the curriculum: 8g«s""e 

Miat I am trying to suggest is that the graduate schools 
are a source of people, both students and faculty, who are: 
(1) independent of life outside the university community, and 
taerefore aore detached in their view of that world, (2) articulate 
ana analytical, and therefore more likely to formulate a critical 
^".u" ^"''^^^ Issues, (3) engaged in a struggle, paralleling 
that of the surgeons earlier in this century, for control of the 
institution that has become more and more specifically adapted 
(like Che hospitals) to meet their particular professional needs, 
and (/») contributing inadvertently to a growing reservoir of 
..rustration and ill-will among the enormously large numbers of 
students, graduate and undergraduate, who have neither the 
inclination nor the capacity to be included among the select 
few but x^ho are nevertheless required to go through the same 
curricuxum. It is after all not only the best curriculum, 
since it was designed to prepare people for graduate school, 
but also the only one (p. 126). 

While the foregoing examples are dravm from comments nade about higher 
education generally one need not look long before seeing evidence of the same 
concerns at the University of Washington. For example, ^n the sprang of 1^0 
the Academic Vice President, .siting for the studen? p^per had tSs L say: 

The large university, the university which in recruiting 
and promoting its faculty very seldom inquires about success or 
potential success in teaching, but only about research productivity 
is confronted by the allegation that its faculty is engaged in a 
mass flight from teaching.' Let us not deceive ourselves; as with 
similar institutions, the University of Washington is impaled on 
the uncomfortable horns of a dilenuna. Ife profess to be first and 
foremost a teachins institution and indeed most of our support 
^M^ f^^oM**"^ government is primarily given to enable us to discharge 
this function but much of our support from the federal government 
and from foundations, comes to us for research and without that 
research our reputation would be local and parochial. 

So today, as never before, scholarly research and publications 
tlourish. Enticing grants and stipends from outside sources have 
sometimes enabled the professor, an airborne holder of multiple 

u . benefices, to absent himself from teaching duties with 
a high degree of regularity to serve as a consultant or to attend 
TTOrkshops, colloquia, and conferences (p. 4). 

eon«?S!??^l^l?^ ""^^ Importance of research, Soloman Katz, nevertheless, and 

goes on to --^""^P^^ions about the relationship of research'and teaching. 



The dichotomy, the 'either . . . or^ argument, w^ilch one 
finds vigorously presented in terms of the supposed mutual 
exclusiveness of teaching and research . I believe is false and 
dangerous. It turns on a false set of alternatives. It suggests 
that some faculty mesbers publish while others are good teachers. 
But there is nothing incompatible betvreen teaching and research. 
A member of i;ha faculty may be heavily coiimitted to research, 
enhancing his own and his institution's prestige. He need not 
thereby neglect his role as teacher in the revalation of knowledge 
from the introductory lecture course to the dialectic of the 
graduate seminar. The evidence of that devotion to teaching may 
not always be available, it may not alxTays be as readily rewarded 
as his research, but unless he concerns himself with teaching, 
he will fall far short of fulfilling one of the major responsi- 
bilities of the calling to which he lus dedicated himself (p. 4). 

The Dean of the College of Arts and Sciences (presently Executive Vice President) 
a^^?ptHJ"'%°S f '''"^^ Economics of Deaning: The Care 

If. Int^^ °y^i^.^^!^^r,''^^^^y Indicated the basis on which faculty members 
are judged. Cartwright stated, "The criterion of quality of the faculty xtill be 
determined almost exclusively . on the- basis of the research scholarship of the faculty 
as evidenced through publication, exhibition, or performance (Cartvnright, 1965, 

the Sniv^rsJJi^ I'Jl!/"^"^!'^' '^^"""'^^ '^^'^^'^^"^^ recognized, 

the University, like nearly every institution of similar status, sees these as 

arpuSicaSon''°"'' ^"^^^^^^ regards for res^rch 

The Relationship Between Research and Teaching: Research 

seemingly inherent conflict between research activities and the 
Zfil J I '^T^'^^e have been the subject of considerable discussion, empirical 

l567 nl S^L^'"" f"" . Investigation undertaken in 

1967 of fifteen universi^es and their departmental2 operation concluded: 

It was clear that many deans and chairmen felt the best way 
to produce quality undergraduate instruction was to develop a 
quality research and graduate program which would attract a good 
faculty. Yet universities chat Iiad the highest ratings on quality 
of graduate programs and the graduate faculty as judged by the 
Cartter report, J tended to place leat^- emphasis on undergraduate 
instruction and showed lowest concern for students (Dressel, 1970, 



adml^^?SMnn'^ f mathematics, psychology, history, English, chemistry, business 
univSSes! ^"Sineering were selected for more intensive study within the 

oVs:dt^??a:u^t^^^^r3 iSs^SdT " 
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!t Similar relationships were stated in a number of different vays through- 

out the book and are quoted here to emphasize tha pervaa.iveness of the t^-n orienta- 
tions, i-or example Dressel, et .al . , reported that "...the deDartnssnts rf-arded as 
eally good were invariably those that were able to demonstrate an actin>e and current 

rerMn^°n/f iT uf ^J''^*'^""^' graduate students, receipt of federal monies, and 
receipt of fellowships from national organizations" (p . 22). 

»on.t,!rf^^' et.al,., also, not .surprisingly, found that more publications p.jr faculty 
member were positively related higher ratings on ?he Cartter Report (1965)4 but 
number^(p!*46) ^""^^^^^ '"'''^ negatively related to f.h.. rate of publication per faculty 

It TTas also reported that "...faculty whosti department« were mentioned favorably 
Lt^,lMn°".^^''^'"/'''^°"] P^^"^ ^ relatively lower emphasis on undergraduate 

i^he^hpr ?^ J . '^'^ report placed a relatively higher er.phasis upon research, 
X7hether it basic or applied" (underlining added, p. 50). 

And finally, from Dressel, et . al . , "Apparently midergraduate instruction and 
lll^lJ^l I "P"sent two distinctive missions xAich go far to determine the 
SrSn?v'*Ji^Wr?nr^^ ^ome faculty perceived them as nearly antithetical; 

certainly high priority on one meant relatively low priority on the other" (p. 76). 

^^'^ focused more directly upon the central question, 
facult^ So ""f University, in a study of teaching effectiveness comparing 

Saf^LS in ? g^^'^^ent research grants T^ith those who had not, found 

SvL ^?07lf J ^"^i;^"^ """^'^'^^^ received higher teacher ratings. 

Hayes 1971) however, in a similar study at Camcgie-Ifellon University, stated, "No 
signiricant relation was found between publication index and either t^Mng qualify 
or student evaluation of teaching"(p. 228). Voeks, in an earlier study (1962) at 
the University of Washington, .found the ratings faculty members receivJ from their 
students bore no significant relationship to their publication rate orf theS m^ber- 
ship in the University's Research Society. Stallings and Singhall (1969) also 

;rcL?sea S inSSL'Sf '""S'^ ^^^^^^ productivity and 'student evaluation 

or courses at Indiana University and the University of Illinois. 



Description of the Study 
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The empirical studies mentioned above, like the statements of opinion, have not 
provided a clear answer to the question. They have, however, suggested techniques 
upon which we built for this study. Dressel's study su:i8est;d thf utlUty^ using 

resef^ch n°M 5 ' f ^^^^'f""^ '^'^^^^ departments as an Lex of ^ 

research and publication; Bresler, Hayes, and Voeks all examined teaching where it 
is operationalized: ir the classroom; Hayes examined the rank of faculty and tl.e 
level at which instruction was offered, but did not, along with Bresler and Voeks, 

Includ^nTH'Jff ""fT '""^^ °' instruction. And these .Sie;, 

? f f different departments, did not differentiate among the areas of 

•knowledge,. This study thus builds upon these past studies, yet examines th- 



Fiediar: and Biglan (1969) in a study of departments at th. University of Illinois 

fritlL'rank? °' l'' ^^'^''^^ ^'^^ °^ deparLentfl facSSe 

wSf "^^ ^ function of size: larger departmevats are more visible. Th 

ranLd Soun^nf'' f ^'ll ""^^^"^^V' ^'^^^^^2^°'^' l^^^^^se, were in the more highly 
ranked groupings. See the staff profiles in Appendix E. 
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relationships from new vantage points. For .in Index of quality In research we used 
the most recent ACE study on the quality of graduate faculties; for an index of 
quality instruction we designed a new student rating Instrument. 



Quality of Graduate Faculties 



o^.r^J^°"^\*'pfp! "^^^ ^ ""^^^"^ °^ national studies of departmental reputation 

?Inlston 'iSgf ^"^^^ '^''^ °" Education, 1934; and 

ueniston, 1939) the most comprehensive were undertaken in 1964 and 1969 by the 
American Council on Education (ACE): Cartter (1966), Rosse and Anderson (1970). 

Raymond Hughes Is credited with the first assessment of quality in Graduate 
education. In 1924. while he president of Ttlami University (Ohio), 1n order to 
more properly advise Iliami undergraduates, requested his facuUy to draw up a Ust 
of recognized scholars in each of tirenty fields of study, to which he then sent 
questionnaires. This technique of assessment based upon the opinions of know- 
ledgeable experts was repeated in 1957 by Hayv;ard Keniston at the University of 

IZof^r t\ ^^"i^5°V^« °^ ^3hed to assess his 

^er?Ln f,^'?-^^"^Y^'^ twenty-five institutions belonging to the Association of 

Sc^:rs^:;ud?::! °^ "^^^^ -^-^^ --^^ -^p-^-^ 

and ^Wpr\^r^'if ^ "^^f Anderson, 1970) is used in this study, 

and shares with earlier studies the general limitation of being essentially a 
subjective estimate of quality. Quality is an elusive attribute, not easily 
oTcu1llLtv°'^'rJr *^hus the ACE sought to obtalA ?he best judgments 

of InstJStJLr? tJ^'.^^^"'^ ^^f-^ °' ^ substantial n^ber 

cLSSf w^^r-ilitU"^^ ' °^ respondents were in general " agreement when 

Sfof facuUy^ °^ f ^^^'^ ^""^ ^^^^ °^ ^^^^^^y- publication 

record of faculty, level ot faculty salaries, number of Guggenheim fellows, and so 

fo^ Zl ' ^'"^^^ ^^^^ ^'^^ founfio b:'mll:dlng». 

tor example, for average faculty compensation in 1965 Harvard was first Parsons 
College second; Berkeley has little endovMent; California Institute of iectaSogy 
has a small library and Michigan and II.I.T. have no nobel laureates. Thus when 
Zrl~Z^.To^^^^^ "° — — - deflnltion^Jhln^the 

r...tTl^^ limitation in using the ACE report as a measurement of departmental 
research reputation is the problem of time lag: (a) between change in a department 
and Se d^' T""''""" f change;^and (b) between the date of tJe IcE studT 

and the date of our student evaluation. Despite this limitation, the ACE report 

P^rserof^SltuT^'"""' °' ~ '^^^^^^ re^utati^f-^S: 

WashJn^tL'^^o'^^^ IZ^^T ^ departments at the University of 

f raS'orLSL'^lSlhre^ as presented in Tables 1 and 2. Table 1 Illustrates 

a rank ordering and three groups of departments: "higher," "medium," and ^'lox/er" 
according to their rating by faculty in the national sa;ple. tII^ grouping JSs 



m 1969?°^ ^^''"^'^ Institutions in 1964, and 6,693 faculty at 130 institutions 

O . the lasff^vr^Ss'"" °' '"'"''^ appointments at the University were made within 
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Table 1 



Rank of University of Washington Departments Based Qpon A,C,L\ Ratinfjs (1970) 



Analytical Percent mo Rated Percent Who Rated 

Group Depaxcments Distinguished - Good and Adequate 

and Strong 



H Geography 53 

i 



Economics, Geology; 
Lower Mechanical Engineering, 

Group Music, Philosophy, 

Political Science, 

Spanish 



36 



g Carman 49 £8 

h 

Ma thematic s 40 33 

r 

English 39 28 



K Sociology 36 40 

e 

d Anthropology 29 53 

u Physics 25 34 

m 

Chemistry 22 33 

Psychology 17 45 

French 16 33 



^Alphabetical 



Table 2 

Rank of University Departments by Area of Knovrledge* 



Departmental 
Group 

HIGHER 



Social Sciences 



Geography 



Area of Knowledge- 



Humanities 

English 
German 



Physical Sciences 
Itathematics 



IfEDIUM 



Sociology 

Anthropology 

Psychology 



French 



Chemistry 
Physics 



LOTffiR 



Economics 
Political Science 



Ilusic 

Philosophy 

Spanish 



Geology 
Mechanical 
Engineering 



^Departments in the natural sciences were not Included in the study for lack of 
departments which were equivalent in name .*iUtoe ranked in the report. 



^ ! f "higher-' category the four departments .;hose graduate 

tZiu^r:"^\ majority of respondents as distinguished and strong; the 

as Pood nfT ^ t T.f S°'f departments rated by the majority of respondents 
Ji J S .f /Jf'^T f"^ category, which we have labeled •'lower," is an 

goSd! listing of departments whose average rating ^s bativreen adequate and 

an though we have grouped certain departments as lower, this ia clearly not 

an indication of low status among departments in a given field of knowledge. f37 
^mple Economics and Spanish, among graduate departments of economics and Spanish 

^"'""g the tO£ third of ranked departments when considered within 
M^Mv ^iT'; departments included in this study are 

highly resardei when considering the 130 institutions included in the 1970 ACE 
llll .l^lTJr,°l P"^P°f s of this study, among highly regarded departments we 
have selected for categories of analysis those which are higher, medium and lower, 
compared with each other. ' "^"-'•"'" ^"-^ -"-ower, 

detan '° "^^T" '^^^^'y °^ teaching, we examined in considerabl. 

fae^e oJw ^ ? I """'^"'^ °^ ^^i'^^ ^« "il^ not seek to review 

here, other than to point out we found that there seems to be substantial agreement 
among researchers.- faculty, and students, that effective teaching IncSes q^aUtSs 

S facr "ZitTT\T^"^' f f ^gi-*^i-' enthusiasm, preparation, and so on! 
In fact, while the terms used from one study to another vary considerablC there 

aood'tLlw 'Vr'^'^^.'^'^'l °' uniformity found in the centrS attrSu?;s of both 
fdLeSJon orLf 5 i°^^^Pl^* --'^h study or opinion we examined included 

resSSher chfse'T^^'?T enthusiasm energy, spirit, zeal or whatever a particular 
puSlcatlonf °n%S I '^J' attribute. Anyone wishing to examine the better 
fmi»r ^ evaluation of teaching effectiveness is referred to Eble (1970) 

Ilildebrand, Wilson and Dienst (1971) and IJIller (1972). U^/u;, 

our r'^Sn/l^^f """"^T^^" publications to deter.t:^.ae which concepts to include in 
our rating scale, we felt that the format and scope of items of the existinc scales 
were inadequate for use in this study. (For our Instrument, see Flg^e A-f 

to til iZTr,: "^"'^'^ ^° designed that there would be maximum agreement as 

JnstrucSo^ f P''"^^- On instruments, the respondent is asked to rate 

Smple: ^ s^l^^^ting a number along a continuum of paired attributes, for 

High 

Enthusiasm 1234557 

He felt it was important to label the numbers with verbal descriptions to Insure that 

thff 'lT?f "f^J '^""^ '^^"^ °' '""^ attribute to all respondents! ?n doing 
this, we followed the descriptive technique of Russel Eidsmoe's instrument (IppendL A. 

the Sten?^tothlT'l ^'^""^ possible, including some measuring 

nf M ^ research is being incorporated into teaching -(since this is one 

of the key arguments for saying that teaching and research go hand in hand) as well 

to r"r''"' ''"'"''^ ^"^^^"^^^ °' ^™ which'a^e unreLled 



of Su^^p^^ ""'^ instrument, three were research-oriented: Knowledge 

of Subject (No. 2), Currentness of Material (No. 4) and Use of (hm Research (No 7) 
The remaining five items represented general qualities of teach^g unrelated 



8 



I 



o 

4> 



o 
d 
a> 
■P 

o 
■P 



1 



o 

■p 
o 



■P 
■P 



4^ 
o 



9 



i 

9 

O 



t:« O 



o 
•f* 



■P 



^ o 

^4 o 



+» © 

o o • 

O i-f o 

P n ^ 

+» w o 

^ ® d 

« -P 5) 



o 



o ^ 



o 



■p 



I 
3 



o 

JO 

a 

o 

t 
I 



■P o 
ea -P 
■P 



■P 
■P 




a 

o 
u 



I 

a 
o 
n 

to 



1 S 

s ° 

^1 n 

3 -P 

o 



o 

S3 

o o 

■P <M 

a 

a ^ 



o o 

n ol 

o n 

O 0) 



o 



o 
-p 



o 



o o 

o o 
■p 



I ^ 

o n 

C3 n 

CJ 0) 



1 



CO 




perliaps Inversely related) to research; Enthusiasm for Subject (IIo. 1), Tolerance 
(No. 3), Presentation (IIo. 5), Availability to Students (No. 6), and Preparation 
(No. 8). 

In addition, Item 5 (Presentation) was chosen because this attribute, tjith 
similar descriptors, VTas used in the Hayes (1971) study to measure quality of 
teaching. By including this item in our instrument, we could test whether the 
finding of a correlation between quality teaching and research varies according 
to the item used to measure the quality of teaching. 



Ileasurinn Quality in s Subjective Survey 

mile the explicitness of the scales developed for this study helps reduce 
unreliability due to variations in interpretation of meanings of scale terms and 
gradations, the question remains whether student respondents are qualified to iudee 
their instructors. ^ 

Several studies mentioned by Costin et.al. " (1971) have shown that students are 
reliable sources of judgments about faculty. In addition, if intellectual ability 
is any indication of ability to rate instructors, then our respondents are well 
qualified as raters, since the academic quality of the students at the University 
of Washington is quite high. In a recently reported comparison of selectivity among 
the larger universities, Astin (1970) reported that the University of Washington was 
second only to Harvard, and ranking above the Universities of Michigan and California, 
in the quality of Its undergraduate student body. Thus, the respondents are among 
the most able in our universities. 

Considering both the ability level of the respondent and the clarity of the 
rating instrument, it is our opinion that this technique yields as reliable an 
indicator as can be presently devised in attempting to measure the elusive attribute 
of quality instruction. 



Respondents 



The respondents were chosen from the University of Washington FTE student body 
of thirty-four thousand. From the individual programs of studies, copies of which 
were obtained from the University Registrar, students taking courses in the 17 
departments studied were randomly selected. For control purposes, an eighteenth 
grouping was selected which included a random selection of students from all 
departments of the University including the departments under study. 

Because the intent of the study was to assess the quality of instruction through- 
out a department, and not the performance of individual instructors, only the depart- 
ment and level of Instruction were identified on the to-be-returned questionnaire. 
Since the study of Hildebrand, et.al. did net find the rating of instruction to be 
affected by the academic rank of the instructor, the number of courses previously 
taken in the same department, the class size, the student's major or whether or not 
the course was required, we did not seek these data on the courses evaluated or on 
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Department 

Geography 

German 

llathematics 

English 

Sociology 

Anthropology 

Physics 

CheD\istry 

Psychology 

French 

Economics 

Geology 

Mechanical Engineering 
Husic 

Philosophy 

Political Science 
Spanish 

All University 



Table 3 
Responsii Rates 

Number Ilailed* Ki^ber Returned Percent Returned 



70 
70 
65 

70 
70 
66 

68 
70 

70 

62 
68 
61 

56 
65 
70 

61 

, '\ 

90 



39 
44 
33 

33 
39 
37 

38 
38 
38 

30 
41 
23 

39 
32 
34 

25 
25 
55 



■55.7 
57.1 
52.3 

47.1 
55.7 
56.0 

55.8 
54.2 
54.2 

48.4 
58.8 
45.1 

69.6 
49.2 
48.5 

40.9 
47.1 
51.1 



1106 



643 



58.1 



ERiC 



* Differences in number niailed out reflect the size of the department. IJhile 70 

the number aimed for in each department, our method of random selection made 
it impossible to select 70 students in the smaller departments. 
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the student respondents (Hildebrand, et .al . , 1971). The cover letter indicated to 
the respondent the specific class selected for rating (see Appendix 3). An 
addressed, business-reply envelope completed the mailing. 

A total of 1106 questiosii-iaires were, mailed, and 643 of them (58.1 percent) were 
returned, forty of which cotdd not be used for the following reasons: illegibility 
of marks. (9), questionnaire inappropriate to format of class (11), and other reasons 
such as late return (20). The remaining 603 constitute the data sample. 

Twenty students Included extensive remarks in addition to their requested 
ratings. Seven critical remarks were based on the position tliat no objective 
Instrument could ever measure the subjective art of teaching. ITotes of approval 
generally expressed relief that "someone is finally doing something about university 
teaching.- The most frequently bitten remark, found on twelve questionnaires, was 
that this method of data collection could not be applied to the seminar-style class, 
found most frequently at the graduate level of Instruction. .At least thirty 
respondents asked for copies of the research report vjhen completed. No apparent 
problem xms encountered in the meclianics of filling out the questionnaire. Question- 
naires were mailed so as to arrive in the hands of respondents towards the end of 
the term, but at least two weeks before the pressure of final exams. 

Table 3 illustrates the sample sizes, number of returns and response rates. 
Non-responses are not considered to be a serious problem in interpreting the 
results, since we are less interested in assessing the actual level of teaching 
performance than making comparisons among departments by their ranking for research. 
Thus, if there is a bias among non-respondenfs it is lihely to bias the results 
evenly across departments.' 



Analysis of Data 

The analysis of the data consists of the following: (1) an examination of the 
internal consistency of the scales of the questionnaire, (2) an examination of the 
differences In the quality of instruction as perceived by students at the three 
levels of instruction, (3) an examination of the relationship between A.C.E. ranking 
of a department and the quality of instruction as perceived by our resoondents, and 
(4) an examination of differences in ranking among the major fields of* study. 

The Scales: Internal Consistency 



Tables 4 through 7 illustrate how the items are related (or not related) to 
each other in inter-correiational matrices. The inter-correlations indicate patterns 
of relationships which are the basis upon which items are combined for Indices in 
later analyses. 

Table 4 iccludes all complete responses from 602 cases. Figure B is a "cluster 
analyrdc' based upon the correlations in Table 4 where higher correlations (r > .60) 



ERIC 



The concern among survey researchers because of non-response seems unwarranted. 
Few. Investigations which have examined the non-respondent have found cause to feel 
the Interpretation given to results from a partial sample would be changed significant! 
by a 100 percent response, e.g.. Cope, 1968. 
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Table 4 

Correlation Itetrix of Scales: Full Number of Cases N = 602 



Enthusiasm 


1.00 












Knowledge 


.56 


1.00 










Tolerance 


.35 


.36 


1.00 








Currentness 


.49 


.50 


.40 


1.00 






Presentation 


.70 


.57 


.47 


.53 


1.00 




Availability 


.38 


.28 


.44 


.30 


.36 


1.00 


Research 


.45 


.50 


.29 


.54 


.50 


.32 1.00 


Preparation 


.52 


.62 


.41 


.44 


.62 


.34 .44 1. 




Enthus- 
iasm 


ICnow- 
ledge 


Toler- 
ance 


Current- 
ness 


Presen- 
tation 


Avail- Research Pr 
ability 



tion 



Figure B 

Cluster Analysis of Data from Table 4 



Low 
r < 35 



Tole 



ranee 



.29 




Research 




.32 



^ — ^ C^^Qwledge 



.28 



-^^ailability 





High 
r > 60 



huslasm 



70 



^ JCno vie dge ^^^ ^ 



.62 



^resentatioiT^-^ (^Preparation^ 
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Table 5 

Correlation Matrix of Scales: Lower Division 209 



Enthusiasm 


1.00 










Knowledge 


.54 


1.00 








Tolerance 


.40 


.37 . 


1.00 






Currentness 


.39 


.40 


.43 


1.00 




Presentation 


.68 


.53 


.47 


.49 


1.00 


Availability 


.26 


.22 


.37 


.27 


.29 


Research 


.39 


.44 


.29 


.50 


.45 


Preparation 


.49 


.61 


.41 


.43 


.58 



Enthus-: Know- Toler- Current- Presen- Avail- Research Prepara- 
lasm ledge ance ness tatlon ability tion 



Figure C 

Cluster Analysis of Data from Table 5 



Low 
r < 35 



High 
r > 60 



(^ ^paration^ .26 (^nowledge^^) ^ --^^ ^ 

.33\^ O^^thusiasm J— presentation^ 

,28^^,JX^^ailabilitjy 27 ^ — ^ 



^^Enthusiasm^^ 



Research^^^ 



28 



Availability 

^^urrentnesT^^ 
^^resentatio^^ 



Knowledge 



^ — (^reparatioiT^ 
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Table 6 

Correlation llatrix of Scales: Upper Division N = 226 



Enthusiasm 


1.00 












Knowledge 


.52 


1;00 










Tolerance 


.33 


.32 


1.00 








Currentness 


.54 


.48 


.45 


1.00 






Presentation 


.69 


.54 


.49 


.57^ 


1.00 




Availability 


.48 


.32 


.47 


.35 


.43 


1.00 


Research 


.44 


.47 


.26 


.48 


.51 


.31 


Preparation 


.51 


.64 


.37 


.42 


.62 


.30 



1.00 
.46 



1.00 



Enthus- 
iasm 



Know- Toler- Current- Presen- Avail- Research Prepara 
ledge ance ness tation ability . tion 



Figure D 

Cluster Analysis of Data from Table 6 




.30.^- ' — ^ .4^^ 

— — ■•-^ ^ — -^^i.^ f Knowledgi 

Research ^\ ^^Currentness^ 
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Table 7 

Correlation Mat;rix of Scales: Graduate N = 168 



Enthusiasm 


1.00 










Knowledge 


.65 


1.00 








Tolerance 


.31 


.39 


1.00 






Currentness 


.56 


.66 


.26 


1.00 




Presentation 


.72 


.64 


.45 


.53 


1.00 


Availability 


.41 


.29 


.50 


.24 


.36 1.00 


Research 


..';4 


.57 


. .31 


.65 


.55 .35 


Preparation 


.58 


.61 


.47 


.50 


.63 .41 




Enthus- 
iasm 


Know- 
ledge 


Toler- 
ance 


Current- 
ness 


Presen- Avail- ] 
tation ability 



1.00 
.48 



1.00 



tion 



Figure E 

Cluster Analysis of Data from Table 7 
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I and loner correlations (r £ 35) are "clustered'^ for the purpose of Illustration. 

fi As t70uld be expected, scales such as Enthusiasm and Presentation are closely related, 

I as are Knowledge and Preparation, while Presentation is related to both Enthusiasm 

I and Preparation. Another vjay of stating these relationships is to say that respondent 

I who found the presentation to be stimulating also believed the instruction was careful 

I prepared and delivered with enthusiasm. 

I More interesting perhaps than the highly related scalss are those without high 

I correlations. The three researclv-oriented scales (ICnowledge, Research and Current- 

I ness) are not found to be highly related to each other , but, more Importantly, are 

I virtually unrelated to the scales of Tolerance and Availability. 

1 Correlations In Tables 5 and C are much like those in Table 4, illustrating again 

I the relatedness of the scales for Enthusiasm, Presentation, Knowledge and Preparation 

I for both levels of undergraduate instruction. Kovjever, in Table 7 the correlations 

I based upon graduate respoases indicate a new clustering of relationships. For the 

i first time the three research oriented scales are found to have high inter-correlatior 



Mean Scale Ratings by Level of Instruction 



I'Jhile data in Tables 4 tlirough 7 illustrate how scales are interrelated at the 
three levels of instruction. Table 8 illustrates mean faculty ratings. Low means 
are indicative of student perception of better teaching. 

On the whole the respondents have given the faculty favorable ratings; most 
ratings are at the level of 2 or 3, and, as one can see from the instrument, ratings 
through 3 were tnritten to describe desirable attributes of teaching. These ratings 
are consistent with other research which has shorn that students tend to rate 
instructors s^^nerously (see Ilildebrand, et: . al . , 1971, p. 11). 

Aside from the fact that respondents tended to g;ive favorable ratings to all 
the forms of instruction measured by the eight scales, most favorable overall 
ratings V7ere given to the instructors' enthusiasm and knowledge for and about the 
subject taught (means of 2.59 and 2.52). Least favorable overall ratings went to 
the attributes of a stimulating presentation of the^subject matter (X = 3.81) and 
the introduction of the instructors' oiTn research (X * 3.48). 

The most significant portion of these data wuld appear to be the consistent 
and marked increased favorability of the rating given to instruction at the lower 
division to graduate levels of instruction as compared on the three research scales: 
Knowledge (#2) > Currentness (#4), and Research (ilf7). Rone of the other five scales 
indicate an equal amount of Improvement, and in only one of the other scales is the 
improvement as consistent (Availability) as it is in the three research scales. 
Figure F illustrates the changes according to levels of instruction for the eight 
scales. (For further analysis of these data, see Appendix Fj Tables 1 and 2.) 



Relationship Between the A.C.E Rank and Student Ratings 



^1 Table 9 sliows the mean ratings on all eight scales given to instruction in the 

seventeen academic departments, which are ranked accr^rding to the A.C.E. ratings 
■ (except for those in the ^lower*' category, which are listed alpliabetically). In 
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Table 8 

Mean Scale Ratings for Instruction In 
in Lower, Upper and Graduate Level Courses 



Scale . Means 





Lower 
Division 


Upper 
Division 


Graduate 


Combined 


Enthusiasm 


2.65 


2.78 


2.34 


2.59 


Knowledge 


2.71 


2.67 


2.19 


2.52 


Tolerance 


3.28 


3.28 


2.91 


2.95 


Currentness 


3.37 


2.88 


2.30 


2.73 


Presentation 


3.90 


4.00 


3.65 


3.81 


Availability 


3.20 


3.02 


2.75 


2.86 


Research 


4.21 


3.84 


3.11 


3.48 


Preparation 


2.81 


2.92 


2.77 


2.81 




N = 209 


N = 226 


N = 168 


N = 602 




ig.F. MEANS BY LEVEL OF INSTRUCTION 
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addition to the means for the scales there is a department average, calculated from 
the scale means. A range and nunber of respondents completed the table. 

The first observation concerning these data, comparing the national (A.C.E) 
ranking with the teaching quality ranks (X^.g and jEr), is that there does not appear 
to be a clear relationship between a high national rating and the quality of 
instruction as perceived by students; in fact, two departments (French and Geology) 
vjith the highest overall ranking for teaching are in the lower Iialf of the ranlcing 
for research. The rank-order correlations between A.C.E ranliings .and teaching 
quality ranlcings were .16 (Xi-g) and -.07 (X"), both insignificant. 

Tlhile the overall rankings for research and for instruction as illustrated in 
Table 9 do not present any consistent relationship for the seventeen departments, 
there is a slight suggestion that within the social sciences there may be a more 
consistent relationship than appears to be true of either tha physical sciences 
or of the humanities. The student ratings and the ranks for the departcents in 
the social sciences are illustrated in Table 10 and Figure G. One can see here a 
slight trend toxmvd better student evaluations in the hi-her-vanked departments 
for questions 1, 2, 4, and 7. That questions 2, 4, and 7 x-Tere the research- 
oriented questions indicates a possibility tliat, for the social sciences, quality 
research may result in more effective teaching. (The rank-order correlation for 
social sciences between national rank and % ranking was +.59; however, the limited 
number of cases makes this statistically insignificant.) 

Table 11 illustrates another ranking system which ras employed to determine if 
research ranlcings might be related to the student evaluation rankings. The 
departmental ranking in this table is calculated from its standing ±n relation to 
• 4^^?''^'"!°?^ ^/"^ discipline; thus. Geography ranked first among departments 

included in this study at the University and second tjhen its percentile was used to 
rank it in comparison to the 34 departments of Geography in the national sample; 
likewise. Physics, which is ranked seventh at the University for this study, is 
also ranked- second when the basis for ranking becomes its percentile rankinc^ as 
compared to departments of Physics. The purpose of this new ranking system°was to 
adjust for any generosity factor" that may have been operating in the former 
ranking system. In that system, a department's rank was based on the absolute 
score it received from other colleagues in the same discipline, so that e. difference 
in the generosity of the members of two disciplines might account for the difference 
in scores received by the respective University of Washington departments. Bv 
re-ranking the departments according to their percentile rank in their discipline, 
we hoped to lessen fcnls generosity factor. 

Somewhat different correlations between national ranking and teaching quality 
r°f^ "^^"^ ^^^^ "'^^ national ranking was used; rho became -.37 for Xi q 

the OS^eiel^ insignificant, and -.50 for ^ vhich is significant at 

In order_ to try to interpret this correlation, it is helpful to look at the 
departments 07 field of study. Whereas VTith the previous ranking system, social 
sciences differed from the humanities and physical sciences in showing a more 
pronounced relationship between research and teaching, with the new ranking system, 
the field of study that stood out was the physical sciences (see Table 12)7 It 

I V^J "r^"^^ negative correlation was strongly Influenced by the 
llf^rlfA physical sciences, which received higher rankings in the re-ordering, 
yet received nearly the loi^est student rankings for research (.^th the exception of 
Geology, for which the converse was true). 
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Table 11 

Rank Order of Departments by A;C.E. Rank and Department Means 





All 


Own Field 




Ranked 


on 




Disciplines A.C. 


E. 




Student Rating 




A.C.E. 




%ile 


R 




\ 


Geography 


1 


6/34 


82 


2 


5 


3 


German 


2 


12/48 


75 


8 


8 


8 


Mathematics 


3 


18/102 


82 


2 


15 


16 


English 


4 


12/92 


87 


1 


7 


12 


Sociology 


5 


13/73 


82 


2 


6 


7 


Anthropology 


6 


16/42 


62 


16 


3 


4 


Physics 


7 


20/113 


82 


2 


11 


14 


Chemistry 


8 




81 


6 




13 


Psychology 


9 


27/110 


■75 


Q 
0 


10 


9 


French 


10 


19/63 


71 


14 


1 


1 


Economics 


11 


19/91 


80 


7 


16 


15 


Geology 


11 




69 


15 


2 


2 


Mechanical 


11 


loni 


73 


10 


17 


17 


Engineering 














Music 


11 


18/43 


59 


17 


13 


10 


Philosophy 


11 


19/65 


72 


13 


4 


5 


Political ■ Science 11 


21/74 


73 


10 


12 


6 


Spanish 


11 


18/65 


73 


10 


9 


11 



23 



Table 12 



Rank Order of Departments by Areas of Knox;ledge 
by ACE Rankings and Mean Student Ratings 



Social Science 

Geography 

Sociology 

Anthropology 

Psychology 

Economics 

Political Science 



ACE, 

1 

5 
6 

9 

11 
11 



ACEj 

2 

2 
16 

8 

7 
10 



Student Ratlngc 
\ 
3 
7 



9 
15 
6 



Humanities 

German 

English 

French 

Ifusic 

Philosophy 

Spanish 



2 
4 
10 
11 
11 
11 



8 
1 
14 
17 
13 
10 



8 
12 

1 
10 

5 
11 



Physical Science 

»lath 

Physics 

Chemistry 

Geology 

Mechanical 
Engineering 



3 
7 
8 
11 
11 



2 
2 
6 
15 
10 



16 
14 
13 
2 
17 



24 
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1. Respondents gave favorable ratings on all eight aspects of instruction 
measured In this study. The instructor's enthusiajsm for and knowledgeability 
about his subject received the highest ratings. Rated lowest were the 
stimulating presentation and the introduction of the instructor's own research 
into the process of teaching. 

2. Knox/ledge, Currentness, and Research, that is, the three research-oriented 
scales were rated consistently better by students taking advanced courses. 

3. I-Jlien departments x^ere ranked according to their A.C.E. rating, no overall 
correlation betr^een quality of research and quality of instruction ras found; 
however, there did appear to be a slight positive relationship for the social 
sciences. 



I'lhen departments were ranked according to their rating in relation to other 
departments in their fields a slight overall negative correlation was found, 
which seemed to be most influenced by the strong negative relationships of 
the physical sciences. 

4. liore obvious than any overall correlations were the differences found among 
fields of study and the uniqueness of departments within these fields. 



Implications 
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Because V73 built upon the results of previous research as we began this study 
, vze were initially inclined to believe our results would be somewhat definitive. 

However, as we have come to a fuller realization of the limits of our research 
design and a fuller understanding of the complexities of academic disciplines, we 
are more certain thzX what we have accomplished is another necessary preliminary 
I examination of a very complex relationship. 

\ We are satisfied that the survey instrument (the scales) is a useful means for 

an examination of teaching quality, especially the portion represented by the scales 

t v;hich were designed to examine the research-related aspects of instruction. We feel 

the instrument would be appropriate for use in future studies of univerSity-level 

I instruction. We were also satisfied v/ith using the department as the unit of 

i analysis, and \jtt\i the Roose and Anderson report as a reasonable way to approximate 

the eminence of a department relative to departments. in other institutions. 

\ We v;ere not satisfied, hox^ever^ with our design of comparing departments within 

\ a university. Because of departmental differences and differences among fields of 

study, we feel a more definitive approach might be to examine the same department at 

different universities. 

Our samples from each department are also quite small, ranging from as few as 
23 respondents in Geology to 44 respondents in German, whereas the student course 
: registrations in these departments approximated 1100 and 1250, respectively. Thus, 

I we feel the mean ratings ahould only be interpreted as an estimate, and the resulting 

i 25 - 



t-nL^^^f T"" °^uf «PP'^°'^i^^tlon, useful as a means of Identlfylne 

tentative rexatlonshlp.^, which ™uld then be subject to more careful scrutiny. 

Th(- reader is also cautioned to recognize that pvpp if nooan„» j4 
found in r.-udies of university faculty wiS the iLl roles tS co^oluSon^fL^ld" 

Is research benefited by scholars who must teach? reiauea question. 

And finally, while the research was carried out at an institution «Mrh ^= 
similar to other large institutions, we should cot be too Ssty ^o oenlraSze to 
other institutions which appear to be similar; substantial differences r^in 

MWs\\f iSlm^M^^'r' ^"""^ ""^^ ^'^'^ universities toch g^ 

uSrad^S tScMn^ ^PP^^'^ '° ^ 8°°^ attention to 

undergraduate teaching than other eminent state universities (such as Berkeley). 
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Appendix 



APPENDICES 



A Sample Page from Rcose and Anderson, 1970 

B Eldsmoe Scale 

C Cover Letter 

D Scale for Student Assessment of Teaching 

E Staff Deplo3mient by Department 

F Details on Scale Means 
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SOCIOLOGY — Social Sciences 

Leading Institutions, by Rated Quality of Graduate Faculty 



1957 



Percentage' of Ritirt Who Indicate: 



Rankings 



"Quality of Graduate Facjity" U: 



1964 



1969 



Inatltutlon 



DIttlnguIshed 
and atrong 



Good and 
adequate 



All 
other 



insufficient 
information 



6 


1 


1* 


1 


2 


1* 


3 


4 


3 


2 


3 


4* 


4 


5 


4*' 


12 


6 


6 


8 


9* 


7 


11 


ir 


8 


5 


7* 


9* 


t 


18* 


9* 


13 


13* 


9* 


i 


7* 


9* 


9 


13* 


13* 


10 


15* 


13* 


7 


9* 


15* 


t 


ir 


15* 


t 


17 


17* 


t 


18* 


17* 


t 


18* 


19 


t 


t 


20* 


15 


t 


20* 



Twenty-one institutions with scores in the 3.0--5.0 range, in rink order 

California. Berkeley 
Harvard 
Chicago 
Columbia 
Michigan 
Wisconsin 
North Carolina 
California, Los Angeles 
Cornell 

Johns Hopkins t 
Northwestern 
Princeton 

Washington (Seattle) 
Yale 

Minnesota 
Stanford 
Michigan State 
Texas t 
Indiana t 
Brwndeis 
Pennsylvania t 



Nina inatitutiona with acores In the 
2.5—2.9 range. In alphabetical order 

8rown t 
Duke t 
lllinojs 

/vf./.r. 

N.Y.U. 
Oregon 

Southern California t 
Vanderbilt t 
Washington (St. louIs) 



91 


3 




6 


91 


5 




4 


86 


6 




7 


83 


11 




5 


84 


8 




8 


80 


10 




9 


67 


24 




9 


51 


33 




16 


51 


39 




9 


47 


31 




21 


AS 


37 


1 


15 


48 


34 




17 


36 


40 




24 


43 


45 


1 


11 


35 


50 


1 


14 


37 


49 




14 


32 


54 




13 


23 


48 


1 


27 


23. 


56 


1 


20 


24 


54 


2 


20 


20 


51 


1 


28 



Italicized instltutlona were not Included in the 1964 survey of this discipline. 

• Score and rank are ahared with anothor Institution. 

t Institution's 1969 score Is in a higher range than Its 1964 score. 

* Not ranked. 

a. Percentages add across; the sum may not total 100 because of rbunoJng. 

b. Institution rated in 1964 was Western Reserve University. 



Sixteen Institutions with scores in the 
2.0—2.4 range, in jqlphabetlcal order 

Buffalo t 

Case Western Reserve t ^ 

Colorado t 

Florida State t 

Iowa (Iowa City) 

Massachusetts 

Missouri t 

New School 

Notre Dame t 

Ohio State 

Penn State 

Pittsburgh 

Purdue 

Syracuse t 

Tulane t 

Washington State 



Sample Page from A Rating of Graduate Programs 
by Kenneth D. Roose and Charles J. Anderson, 
American Cotmcil on Education, 1970, Reproduced 
with perrrtission. 



A STUDENTS RATING SCALE OF AN INSTRUCTOR 



. Course 



„ Date. 



Instructor's name (Please print) 

h^T^^aicolSl^n\Vf^^ ^^"^ sections. Each section is divided into three degrees and num- 

wWch bes? ^^^''^ ^^^"^ ' ^ ^^^^ ^ the number 

Your fair and honest opinion is what really counts. Ycur instructor desires this rating for his own self-improvement. 

ORGANIZATION OF COURSE 



PREPARATION FOR 
EACH CLASS 



W«U organized: shows thought- Soms orranlEation but not al< 
ful planning, ways clemr. 



.7 8 9 

Lacks organU&tlon; pUnntnt 
sesms vai^ue. 



Showa definite evidence* 
careful preparation. 



of 



Shows some preparation; av- 
era«;s knowledge of course. 



8 



9 



Not well prepared; 
Inaccurate at times. 



knowIed£« 



TiBACHZNG SKILL 



6 



Prcduces steady Interest In Teaching procedurs ssldom 

SUDject: * — ~" ■ " ' - . r . . 



__7 8 9 

Classes tend to be dry and un*- 



k"ci^R Vh!nw*m?vlng!^* c^t^e?'*' '"^^^ Interesting; class period dr«cs. 



ENTHUSIASM AND 
INTEREST IN COURSE 

ASSIGNMENTS 



JUDGMENT OF VALUES 



CLASS DISCUSSION 
AND QUESTIONS 



6 



8 



9 



.ngP »cs*7.?t?;e^st^^^^ te»" "''^"'^^^ o^f J^t'buVuiST.^^^^^""- "'^^^ 



Students understand the tasks ouincuinca rsiner in 
of each new assignment. Stu« without clear planning 
dents know what la desired. 



J 5 6 

Sometimes rather Indeflnlts; 



7 8 9 

Usually hurriedly given: rath- 
^r vague: sometimes very un- 
reasonable. 



8 



9 



i^H^"?**?^ selects Important tsometlmes overlooks Impor- ^'Frequently misses itnDortanl 
Idoau: i>roadons .vtudont vlow i^nt^^Jlolnt.^ ^P-aing time on lde«^ oveUphSs?xe.«^^?r7vY.S 



2 3^ 

Questions challenging; demand 
sound thinking; discussions in- 
teresting and stimulating. 



6 



8 



9 



.i5ni?."°Jl"«,l!i^-S* XJiacussion sometimes without 

«i"?i*L. P^rPote; dlscus«lcii« fluently 

pnasized. ramble. 



POISE AND SELF- 
CONFIDENCE 

EXAMINATIONS 
SCHOLARSHIP 



Well poised; sure of himself; 



not easily upseL 



1 2 3 

Questions thought-provoking; 



carefully selected; clear. 



Excellent mastery of subject; 
has broad Interests. 



4 5 6 

Seems embarrassed at times: 

fairly self-confident. 



Easily upset; uncertain as to 
procedure; lacks confldetics* 



Questions usually factual; re- Examinations poorly planneil 
quiro llttio thinking. and managed. pi^nnoa 



Knowledge fair but without Knowledge frcfjuently Inade^ 

quate. Instructor seems vagueu 



ABILITY TO CREilTE 
STUDENT INTEREST 

CLASSROOM MANAGEMENT 
AND DISCIPLINE 



ln'^f«"b'-!?t;'ytr^ulM^ orMt?^^*^^*"*^^'^^""^ lnd«t'"^""' '^"^^"^ 



.1 2 3 

^Bti^cTent management: itu^ 
dents orderly and attentive. 



, Satisfactory organlratlon ; few 
oblems. 



dlsclpUnaiy probT 



Poor organization; many dis- 
ciplinary problems. 



SPEECH 
TOLERANCE 



Voice -pleosant; 
tlnctly, fluently. 



speaks dl8« speaks reasonably weUT 



1 2 3_ _4 5 6 

Encourages students to ex- At times eppijars to^Se^dlil 
differ with the instructor's i*ents oppose l!58truntor*s v1«wb« 



7 8 9 

Enunciation poor; makes fre^ 



Quent crA-oi'.Y in 8peecli« 



Resents opposition; intolerant: 



SENSE OF HUMOR 



PERSONAL APPEARANCE 



Possesses keen sense of humor. Moderately humorous"at Umes. ' showa ilttie or no sense " ' 6 1 

humor; Quite sober and serious. 



Neatly and appropriately 
dresse<f<; well groomed. 



_Z I ?_ _7 8 9 

ag-S^'lSpSnT' careless in dress; unUdy. ' 



RELATIONSHIP BETWEEN 
STUDENTS AND 
INSTRUCTOR 



£Sr^"^"^'^"« sS'SE^'""'-^- '^W^^^&s^. 



Instructor* 



^^OnTe^\1ktf^ ""^^ ^^"^ instructort selMmprovement Do not algn your namt. 

on the back of this form PRINT any annoying mannerisms your instructor has developed which should be^rrected 

CopyriKlit. 1&70. hy 



Dr. 



RuHsel! 



?^ Wpnilneslde, College,.,SIoux^Clty.„Iow»..6U0«. 



Student Assessment of Teaching 



FACULTY-STUDENT 
RESEARCH TEAM: 



Robert Cope 
Judy Richard^^on 
John Mc Mil I in 



University of 
Washington 
M^217 
Miller Hall 

Seattle 

Washington 

98195 

Phone 
543-1891 



May 19, 1972 



Dear Student: 

People Involved In Higher Education are currently 
attempting to determine the characteristics of effective 
teaching. The person bein.e. tauf;ht is probably the best 
source of useful data; therefore, your help ir needed in 
a study of some factors that make up effective teaching. 
The research is being conducted by a team of student^ and 
faculty here at the University of Washington. 

According to enrollment records, you are presently 
a student in 



and we are asking you to complete the enclosed brief 
questionnaire concerning the instruction in that course. 

As you will see, the numerical code on the quefstion- 
naire indicates only the department and course level, thus 
assuring anonymity for both you and the instructor. 
Because of this anonymity, participation in the project 
could in no way effect your jjrade or reflect on the 
instructor, and is in no way a requirement for the class. 

Please return the questionnaire in the enclosed 
postage-paid envelope as soon as possible. It is important: 
for the research that we receive your response to each item, 
but you may leave blank an item you find inappropriate 
for any reason. Feel free to call or visit any of us if 
you have a question, or if you wish to have a report of the 
, findings . 

Thank you I 
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Notes on Appendix E 



(1) Ranked faculty are shown in terms of Autumn Quarter 1971 faculty count, 
where each full-time faculty member =1.00 faculty count. Ranked 
faculty includes: Professor, Associate Professor, Instructor, and 
Lecturer. 

(2) Sub-faculty shovm in terras of Autumn Quarter 1971 faculty count, 
where Part-time Instructors, Part-time Lecturers, and Pre-doctoral 
Teaching Associate ll's are counted at the same rate as ranked faculty 
and Pre-doctoral Teaching Associate I's and Teaching Assistants are 
counted at half that rate (e.g., each half-time T.A. = .25 faculty 
count) . 

(3) Research Assistants are shown in terms of F.Y. 1971 head count and 
include Pre-doctoral Research Associates. 

(4) Sponsored Research are based on F.Y. 1971 data and exclude teaching 
grants and fellowships. 

(5) The student faculty ratio include both ranked and sub-faculty as a 
base and are based on a weighted F.T.E. student distribution. This 
weighting reduces all students to lower division equivalents where: 
lower division = 1.00; upper division - .1.33; graduate students = 
2.86; and graduate students doing independent study, thesis, or 
dissertations =4.00. 

(6) F.T.E. students were developed from Autumn Quarter 1971 student 
credit hours (SCH) . They were computed on the basis that 15 under- 
graduate SCH's per undergraduate student and 10 graduate SCH 's per 
graduate student. 



(7) 



(8) 



The percent of faculty time spent on research was computed from 
Autumn Quarter data and developed from a comparison of the percent 
of time spend on research by faculty rank and the teaching break- 
down by rank. 

Data for the Departments of French and Spanish were calculated on 
the assumption that each represented approximately one-third of the 
Department of Romance Language and' Literature . 



Tables 1 and 2 (Appendix F) help answer the question, "is the qualitv of 
instruction offered by levels of instruction related to Jhe rankLHf tL 
departments for research?" Again the answer appears to bT"no?" ?here Js 
noteJ ''^f relationship for the scales in either table, except as 

noted earlier for the improved ratings on research oriented scales as the 
level of instruction increases. There is, however, a bint of a curvilirLr 
relationship with the most favorable ratings on th^ eigirscales receivefL 
departments in the medium ranking (note the asterisks on TaMe 1) fif teen ' 

^^^T^J^^ ^^V^ r~L?a™Lrs ?or-u-fit. 



Table 1 



Means on Scales by Grouped Rank of Departments 
and Level of Instruction 



artments 


Scales 


Lower 


Upper 


Graduate 






Division 


Division 




H 


1 


2.15* 


2.43* 


2.30 


I 


2 


2.71 


2.60 


2.30 


6 


3 


3.30 


2.86* 


3.38 


H 


4 


3.25 


3.31 


2.59 


E 


5 


3.88 


3.59* 


3.58 


R 


6 


2.82* 


3.08 


2.88 




7 


3.74* 


3.84 


3.44 




8 


3.01 


2.92 


2.51* 


M 




(53) 


(53) 


(43) 


1 


2.48 


2.82 


2.23* 


E 


2 


2.47* 


2.54* 


2.09* 


D 


3 


2.89* 


3.46 


2.72* 


I 


4 


3.14'' 


2.83 


1.86* 


U 


5 


3.30* 


4.03 


3.46* 


M 


6 


3.37 


2.96* ■ 


2.84 




7 


4.02 


3.83* 


2.68* 




8 


2.25* 


2.90* 


2.63 






(80) 


(85) 


(54) 


L 


1 


3.06 


2.86 


2.42 


0 


2 


2.80 


2.69 


2.12 


W 


3 


3.45 


3.32 


2.95 


E 


4 


3.68 


2.73* 


2.37 


R 


5 


4.40 


4.39 


3.88 




6 


3.23 


3.11 


2.55* 




7 


4.57 


3.93 


3.20 




8 


3.16 


2.93 


3.04 






(76) 


(83) 


(63) 



* Most favorable scale rating based on column comparison 



Table 2 

Means on Research Scales by Grouped Rank of Departments 
and Level of Instruction 



Departments Scales 



Higher 



Medium 



Lower 



Scales 


Lower 


Upper 


Graduate 




Division 


Division 


2 


2.71 


2.60 


2.30° 


4 


3.25 


3.31° 


2.59° 


7 


3.74* 


3.84 


3.44° 




(53) 


(53) 


(43) 


2 


2.47* 


2.54* 


2.09* 


4 


3.14* 


2.83 


1.86* 


7 


4.02 


3.83* 


2.68* 




(80) 


(85) 


(54) 


2 


2.80° 


2.69° 


2.12 


4 


3.68° 


2.73* 


2.37 


7 


4.57° 


3.93° 


3.20 




(76) 


(83) 


(63) 



Most favorable scale rating based upon column comparisons. 
Least favorable scale rating based upon column comparisons. 



* 

° Lea 



